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Abstract 



The English-language literature since 1950 was searched to 
gather published reports of abstracting and indexing rates and 
costs, and cost figures for the complete preparation of secondary 
publication. The search located relevant information for 24 
abstract journals and 3 citation services, 18 abstracting cost 
figures, and 41 indexing cost figures. These reported figures 
were extracted with text or other amplifying comment and tabu- 
lated, with reference made to the included 79-item bibliography. 
Unit costs per bibliographic item were cited or computed. These 
data were plotted to detect possible patterns or trends. The 
reported unit costs for preparation of the secondary services 
were adjusted for 1968 dollar value and were plotted by number 
of items cited annually. Abstracting costs an^ indexing costs 
were each plotted chronologically, and then in rank order with ~ 
dollar value adjustments. Abstracting and indexing rates were 
plotted. The plots serve to illustrate the scattering of the 
data and emphasize the problem of drawing generalizations from 
the existing data. 




BACKGROUND 



This report is meant to be a comprehensive compilation and review 

of the literature relating to the costs of abstracting and indexing — 

both for the whole system of preparing and distributing an abstracting, 

reviewing, or indexing publication, and for the abstracting and indexing 

alone. This work builds and expands upon the review work done earlier 
40 62 67 

by Landau, Schutze, and Stevens. This report provides a complete 
bibliography of the relevant works that were identified, and also ex- 
tracts and summarizes much of the data given in these reports. 

The coverage for this report was restricted to the English-language 
literature from 1950 to the present. We emphasized the coverage of 
those publications that reported their actual experiences with abstract- 
ing and indexing operations. The data given in those publications was 
extracted and summarized in this report as given in or inferred from 

i 

the original publications. The given data were plotted as a function 
of the year reported. In addition, the cost data for each year were 
normalized to the accepted 1968 consumer dollar, which was the one 
modification we felt could be made without additional information. 

Aside from making this adjustment for the dollar inflation over the 
years, we made no attempt to normalize or in any other way modify the 
reported data, although such modifications might have been appropriate 
in order to do such things as standardize the treatment of general 
overhead costs. 

Almost every one of the original reports was concerned with the 
processing of scientific or technical literature, in the usual forms of 
articles, patents, reports, and so on. In that regard, the reported 
data can be considered to be on a somewhat comparable basis. 

Most of the cost reports were incomplete or faulty in some respect. 
This naturally limited the utilization and extension of the data provided. 



Based on U.S. Department of Labor, Bureau of Labor Statistics, Consumer 
Price Index. 1970 World Almanac, p. 96. 



These difficulties are discussed in more detail in later sections of 
this report. 

Some of the data reported for a given service by several sources 
was contradictory. Examples of some of this can be seen in the tables 
of this review. In these cases of duplicate reporting, it is probable 
the included factors differ, and because we cannot standardize these 
factors, each report is taken as provided. 

Some data was also obtained from personal communications in order 
to provide supporting information and a fuller context for the data 
from the literature. Letters were written to many of the abstracting 
and indexing services, requesting rate and cost data that could be 
used for this review; however, most of these services either ignored 
the request or said that the data was unavailable . 
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I GROSS COSTS TO PROVIDE SECONDARY SERVICES 

The literature covered in this section relates to the total cost 
to provide a secondary publication service. This is defined to be a 
service that reviews source literature; prepares a bibliography, index, 
abstract, or review publication; and distributes that publication to 
a number of recipients. This definition includes the familiar secondary 
services such as Biological Abstracts and Index Medicus , as well as some 
lesser-known examples. This can include in-house publications as well 
as publications that receive more extensive distribution* 

The reader of this section is cautioned to refrain from making 
too literal an' interpretation and comparison of the data reported here. 
This data can provide only order of magnitude estimates of the costs of 
a secondary service, rather than absolutely precise figures. Further 
detailed study is necessary to develop cost data that would be more 
exact and directly comparable. The assumption of the present work is 
that any specific comparison is suspect, but that there is some validity 
in the total compilation. 

The data in the original reports have been used in this summary to 
derive a gross cost per bibliographic item processed. In some cases, 
a gross unit cost was given in the literature; for other cases this 
was computed by taking the reported total annual cost of a given ser- 
vice, and dividing it by the total number of unique bibliographic items 
(articles, reports, books, patents, etc.) published by that service 
during that year. These computed gross unit costs are indicated in 
parentheses, and must be used with at least as much caution as cost 
figures provided directly by the services, because they lack verifica- 
tion. Each unit cost figure for a given year represented a single case 
history data point for this review. For several secondary services, it 
was possible to obtain such a cost figure for several different years. 
The data gathered in our search, as reported and as computed from the 
reports, is shown with text and references in Table I. 

There are many differences in the methods used by various services 
to report their costs, making it hazardous to draw direct comparisons 



of the figures reported for different services. Most of the difficulties 
stem from differences in what cost elements are included in the costs 
reported by the various services. The following factors contribute to 
the difficulty of comparing the services' unit costs, or of considering 
them to be the exact costs of production: 

. Some services use volunteer or near-volunteer labor, others 
have to pay all the contributors 

. Some services have to pay for the source materials, many do 
not because they use the library services of a cooperating 
institution 

* Some services have research and development costs that may 
or may not be included in the reported expenses 

Some services may have special non-recurring costs (e.g., 
purchase of new equipment, file conversions, special 
development efforts) 

. Some services have subsidies in the form of staff, office 
space, printing, mailing, R&D grants, or other services 
1 that are provided by another organization and may not be 
included in the reported costs 

. Some services, particularly in recent years, have developed 
a mix of publication processes and information services 
that make it difficult to assign a cost to separate parts 
or services. A good example is the difficulty of assigning 
a gross unit cost to Chemical Abstracts , when the same large 
production facility also provides Chemical Titles , Chemical- 
Biological Activities , and other secondary publications; 
magnetic tape services; chemical compound searches; refer- 
ence handbooks; and the compound registry system 

. Services differ in printing (type of composition and printing, 
number of copies) and distribution (e.g., first class, book 
rate, government franked mail) expenses 

. Some services report employee benefits and overhead costs, 
others do not 

. There are variations in the type of abstracting provided 

(e.g., copy from other service, annotation, author abstract, 
new abstract, critical review) 

There are variations in type (KV/IC, deep indexing with con- 
trolled vocabulary) and amount of indexing provided (indexes 
with each issue, quarterly, annual, 5-year cumulations; index- 
ing by author and the usual access points, or special indexes 
such as chemical formula or notation indexes) 
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. There are differences in the data due to different dates of 

reporting (1950 vs. 1970 data) with the changing salary 
rates, techniques, as well as changing value of the dollar 

The gross unit costs for more than 20 services, as extracted from the 
literature or obtained by the methods described earlier, are summarized 
in Fig. 1-1 as a function of the annual production volume of items of 
each service, and adjusted to 1968 dollar values. The symbols used in 
this and other figures are identified in the tables associated with the 
figures. Reported costs for the bibliography or title listing services 
ranged from $2.18 to $2.24 per citation; when adjusted to equivalent 1968 
dollar values, the unit costs ranged from $2.58 to $2.63 per citation. 

Reported costs for abstracting services were generally higher, 
ranging from $1.59 to $57.96 per abstract. When adjusted to equivalent 
1968 dollar values, the unit costs for abstracting services ranged from 
$2.30 to $57.96 per abstract^. 

There are too many differences in the data points (e.g., single 
points vs. several points for the same service, old data vs. current 
data, large volume production vs, small volume production, volunteer 
abstractors vs. paid abstractors) to make it particularly meaningful 
to talk of mathematical averages of all of this data. Further study 
is necessary in order to assemble these data points into major para- 
metric or comparable groups, and perhaps make some adjustments to them 
before any meaningful "average” figure could be developed. At this 
point, the only valid generalization that can be made is that the gross 
unit cost to provide an abstracting service is likely to be in the range 
of $5-30 per abstract. 

\ 

For those services for which more than one data point was avail- 
able, no clear pattern emerged regarding the unit cost as a function of 
the calendar year or volume of coverage. For some services, the unit 
costs generally increased each year; but for some services it generally 
decreased each year. For some services, the unit costs increased as 
the service processed a larger number of items; but for some services 
the unit costs decreased with increasing volume of coverage. There 
was insufficient data to make a valid generalization on these points. 



II RATES AND COSTS OF THE ABSTRACTING PROCESS 

Those publications that reported the rates or costs of the abstract- 
ing process by itself, independent of the other costs of running an 
abstract service, received a separate analysis and review. These source 
reports also suffer from the same inexactness and incompleteness of 
reporting that was described in the previous section. Consequently, 
the reported rates and costs should be reviewed carefully before making 
di rect comparisons . 

The rates and costs reported for the abstracting process are given 
in Table II. Some of the reports included data on both indexing and 
abstracting, and for some of these it was not possible to separate the 
rates or costs of each process. For those instances in which the 
abstracting and indexing rates or costs could not be separately iden- 
tified, the total cost was used and appropriately identified as a com- 
bination of both* 

The abstracting costs in 19 reports ranged from $0.43 to $13.00 
per abstract (excluding a special case of $250 per abstract); with 
most of the costs clustered between $2-8. This costs data is summarized 
in Fig. II-l as a function of the year of the reported data. The nor- 
malized data are plotted in Fig. II-2. There is considerable variation 
in the reported data, and a mathematical average would not have much 
meaning for this mix of data (because of the combinations of reported 
ranges vs. single points, large samples vs. small samples, single vs. 
multiple points from the same facility, abstracting only vs. abstracting 
plus indexing). However, an estimated "average" or representative cost 
would seem to be about $5 per abstract. 

Only five abstracting rates were found in reports: 4-8; 6-7; 

8; 10; and 8-16 abstracts per man-day. These are illustrated in Fig, II-3. 
Based upon this data, a representative • or "average tf rate for the abstract- 
ing effort would seem to be about 8-9 abstracts per man-day. 
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Ill RATES AND COSTS OF THE INDEXING PROCESS 

Reports of the rates or costs of the indexing process itself 
received a separate analysis and review. As with the abstracting 
reports, these also suffered from incompleteness and variances in 
reporting. Consequently the reported data should be reviewed with 
care before making direct comparisons. There were many more reports 
regarding indexing data than there were for the abstracting data. 

The rates and costs reported for the indexing process are summarized 
in Table III. 

The indexing costs reported for more than 20 case studies ranged 
widely from $0.23 to $250 per indexed item, with most of the costs 
clustered between $1-20 per indexed article or report. This reported 
cost data is summarized in Fig. III-l as a function of the year of the 
reported data. The same data, adjusted to the 1968 dollar values, 
are shown in Fig. III-2. Even disregarding the extreme points, there 
is still a very wide distribution of reported costs, with most of the 
data falling between $1-20 per indexed item. The differences would 
seem to be due largely to differences in basic factors such as type 
and depth of indexing, degree of vocabulary control, and type of 
source material indexed. Further study is needed in order to sort 
out this data into more meaningful groups according to some of these 
factors. It would be misleading to postulate any "average" indexing 
cost from the data assembled here. 

The indexing rates reported for more than 20 case studies ranged 
widely from 2.4 to 160 indexed reports or articles per man-day. These 
rates are illustrated in Fig. III-3 as a function of the year of the 
reported data, and in Fig. III-4 in rank order. As with the indexing 
cost data, there is still a wide variation in the values of the reported 
indexing rate data, and probably for the same reasons described for the 
cost data. Most of the data falls in the range of 8-30 indexed reports 
or articles per man-day. As with the indexing cost data, further study 
is needed to group these case histories into major parametric groups, 
and any statement of "average" indexing rate would be misleading for 
this mix of data as reported here. 
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SUKMARY 



The costs reported for abstracting and Indexing services and 
processes were described in earlier sections, and are summarized 
below: 

Gross Unit Costs to Provide Secondary Services (cost per abstract 
or citation) 



o 







Number of 
Services 
Studied 


Range as 
Reported 
<$> 


Range as 
Adjusted 
to 1968 
Dollar 
Value ($) 


Represen- 
tative 
1968 Cost 
<$) 


Citation 


Services 


3 


2 . 18-2*24 


2.58-2.63 


2.60 


Abstract 


Journals 


24 


1*59-57.96 


2.30-57.96 


5.-30.00 


Abstracting Process 


(cost per abstract) 







Number of 


Range as 


Range as 
Adj usted 
to 1968 


Represen- 

tative 


Services 


Reported 


Dollar 


1968 Cost 


Studied 


($> 


Value ($) 


<$) 


14 


0.43-250.00 


.51-327.50 


5.00 



Indexing Process (cost per indexed report or article) 







Range as 




Number of 




Adj usted 


Represen- 


Organi- 


Range as 


to 1968 


tative 


zations 


Reported 


Dollar 


1968 Cost 


Reporting 


($) 


Value ($) 


_<$> 


26 


i 

0.23-250.00 


.28-327.50 
(1-20 for 





most points) 



The rates reported 


for the indexing and abstracting processes 


are summarized 


below: 


Number of 
Reporting 
Organi- 
zations 


Range of Rates 


Represen- 

tative 

Rates 


Abstracting 

/ 


5 


4-16 abstracts/man-day 


8-9 ab- 
stracts/ 
man-day 


Indexing' 


20 


2.4-160 indexed reports 


— 



or articles/man-day 
(8-30 for most points) 
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The published accounts generally provided inadequate description 
and supporting details to permit direct comparisons or extensions of 
this data. Any further generalizations regarding rates or costs of 
abstracting and indexing must wait until the data itself can be studied 
in detail, or until . arrangements can be made to work directly with some 
abstracting or indexing operations to collect their data in a systematic 
and consistent manner. 

The authors are interested in continuing this investigation, and 
expanding their findings with additional data. Hence we would welcome 
receiving any additional reports or data on this topic that you might 
care to send to us. 
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Total 



Publication 



Year 



Total Number 
of Abstracts 
or Citations Production 
Processed Cost for 
During 
That Year 



Average 
Cost per 
Abstract or 
Citation ($) 



That Year 

($) 



As 

Given 



p Aluminum Technical Infor- 
mation Service 



1969 



5,000 est. 



14.56 




D Applied Mechanics Review 



O Biological Abstracts 



it Bulletin of British Scien- 
tific Instrument Research 
Association 



1964 


7,600 

* 


131,000 

* 


17.20 

* 


(19.28) 


1 


FY1962 


90,215 


202,447 


2.24 


(2.58) 


Th 

suj 

1 


1955 


20,058 




7.00 


(9.09) 


"A 

Bi> 

•i 

vo. 


1956 


30,080 


305,000 


(10.14) 


(12.98) 


1 


1964 


107,000 


929,000 


8.70 


(9.75) 




1966 


180,000 


1,500,000 


(8.33) 


(8.92) 


Th 

se; 


1967 


215,000 


2,150,000 


10.02 


(10.44) 


j 


1968 


220,000 


2,200,000 


10.04 


(10.04) 




1950 


2,461 


3,360 


(1.59) 


(2.30) 


To 

of 

Pr: 

mal 

inf 

ass 



* o 



Services which do not provide abstracts with the citations. 

( ) Figures computed by the investigators, based on the reported data. 
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Comments 



Refs. 



|ee 
Iper 
it or 
% <$) 

| 1968 
I Value 

1(14.00) 



Monthly abstract journal with monthly index and annual cumulative 
index. Abstracts are bought from Amer. Soc. for Metals at fixed 
unit price. 



27 



(19.28) 

(2.58) 



(9.09) 



I (12.98) 
I (9.75) 
I (8.92) 

I 

\ (10.44) 
| (10.04) 

I (2.30) 

I 



This cost includes salaries, fringe benefits, printing, equipment, 
supervision, and management. , 



12 



48 



"At present it costs us roughly seven dollars an abstract to produce 16,33 
Biological Abstracts . . . about 50% of our abstracts are written by 
volunteer abstractors." 



This included 2/3 abstracts and 1/3 title listings for all of their, 
services. 



Total cost to prepare an abstract bulletin and its indexes, 12 issues 
per year, 2,461 abstracts, was^f*l,400. "The Bulletin consists mainly 
of abstracts. These are prepared by the scientific assistants. 
Printing costs are about half the total, costs, so that the cost of 
making the abstracts, classifying, proof-reading, editing, and index- 
ing is about 5s. 8d. per abstract (9s, including overhead)." It was 
assumed that the 1950 jr had a value of $2.80., 



56,75 

12 

56,75 

75 

75 

29 



Table I 



!' Costs to Provide Secondary Services 




Publication 



Year 



□ Chemical Abstracts 



1960 

1960 



1963 

1963 

1964 
1964 



O Computing Reviews 



FY1967 

FY1968 



* 



t Current List of Medical 
Literature 



A Documentation* Abstracts 
(now Information Science 
Abstracts) 



O 

ERIC 



Total Number 
of Abstracts 
or Citations 
Processed 
During 
That Year 



Tota^. 

Production 



Cost /for 



Average 
Cost per 
Abstract or 
Citation ($) 



That /Year 

/($} 



As 

Given 



1968 

Given 



132,159 

132,500 



/ 



2/650,000 

650,000 



(20.05) (23.60) 

(20.00) (23.54) 



170,000 

167,256 



188,000 / 



187,911 



/4, 550,000 
4,550,000 
4,904,850 
4,904,850 



(26.76) (30.40) 

(27.20) (30.90) 



26.00 (29.15) 

(26.10) (29.26) 



(2,230) 

7 

(2,467) 



99 , 274 
142,975 



(44.52) (46.39) Thi 



(57.96) (57.96) Thi 



1958 


106 , 513* 


232,385* 


* 

2.18 


(2.63) 


1967 


1,327 


10,460 


(7.88) 


(8.21) 


1968 


1,570 


27,991 


(17.83) 


(17.83) 


1969 


2,638 


28,446 


(10.78) 


(10.14) 



.-a 

vie 

■a 

sem 



ind 
f r| 



Table if 

Representative Gross Costs to p| 

1 

(continue 



| Average 
j|Cost per 
jbstract or 
fi tat ion ($) 



e- 

1 ' H 

2.18 

t 



7 . 88 ) 



lS 


1968 x 


yen 


Given 


|o5) 


(23.60) 


).00) 

i 


(23.54) 


r 

3.76) 


(30.40) 


|.20) 


(30.90) 


5 .oo 


(29.15) 


3.10) 


(29.26) 


I- 52 ) 


(46.39) 



Comments 



"it cost $2,650,000 to produce CA in I960, and $4,550,000 in 1963.” 
The June article stated that there were 170,000 abstracts in 1963 CA. 



KWTC Index . 

7,96) (57.96) This cost includes salaries, printing and mailing expenses, and the 

KWIC Index. 



(2.63) Costs include personnel, equipment, supplies, printing, contract ser- 
vices, and distribution costs. Overhead, and the cost of printing 
semi-annual cumulations are excluded. 

(8.21) 1966 was first year of full operation. Volunteer abstractors and 

indexers are used. Approximately half of the abstracts are lifted 
| from other sources. 

7.83) (17.83) 

3.78) (10.14) 



| Table 1 

I 

a Gross Costs to Provide Secondary Services 
l (continued) 



Refs . 

59 

13,14,63 

13,14 

59 

12 

59 

5 

6 

50 



42,65 



42,65 

42,65 



i 




Publication 



^ Engineering Index 



/ 

/ 



o Geoscience Abstracts 



O 




Total Number 



Average 



1970 



1964 



65,000 

est. 



6,000 



1,032,072 

est. 



15.87 
est o 



Year 


of Abstracts 
or Citations 
Processed 
During 
That Year 


Total 

Production 
Cost for 
That Year 
($) 


Cost per 
Abstract or 
Citation ($) 
As 1968 

Given Value 


1957 


26,797 


163.413 


6.09 


(7.53) 


1958 


27,945 


184,208 


6.59 


(7.9 4) 


1959 


29,770 


219.240 


7.36 


(8.79) 


I960 


33.071 


256.566 


7.75 


(9.12) 


1961 


36,614 


283,131 


7.73 


(9.00) 


1962 


38,120 


344,885 


9.04 


(10.40) 


1963 


41,703 


336.110 


8.05 


(9.15) 


1964 


43,622 


479.552 


10.99 


(12.32) 


1965 


45,001 


781,867 


17.37 


(19.16) 


1966 


51,412. 


904,639 


17.59 


(18.85) 


1967 


51,670 


1,064,248 


20.59 


(21.45) 


1968 


51,724 


1,124,924 


21.74 


(21.74) 


1969 


52,899 


1,014,462 

est. 


19.17 


(18.04) 



81,000 13.50 (15.13) 



■x 
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Monthly! 

Electril 
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program 
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••Plans! 
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Table I 



Representative Gross Costs to Provic 

(continued) 



/ 



fr 

for 




/ 



tlue 



Comments 



References 



% 53) For 1957-1961, items abstracted and indexed were processed for two El 79( related 
^.94) information services: The Engineering Index Annual publication but contra - 

5*79) which includes an alphabetical arrangement of all abstracts produced dietory 

?,12) by El, cross referenced to related subjects, and a complete author data given 

? e 00) index; and the El Card Service available in some 249 divisions of in 10,12, 

)»40) engineering interest. For 1962-1964, items were processed for three 20,33,34, 

?»15) services: the Annual , the El Card Service ; and (since October 1962) 49,51,63, 

J.32) for the El Monthly, designed on the same basis as the Annual . For 66 

?.l6) 1965-1967, items were processed for: the Annual . El Card Service. El 

3 . 85 ) Monthly : and (starting in January 1965) for Plastics Monthly and 
L.45) Electrical and Electronics Section each of which provide: an author 

1.74) and a deep subject index produced for computer processing, and a 
3.04) cumulative annual author and subject index; also computer tape pilot 

r /rmn tt — n — . t .xi -n a nvm-p r\ -r._ x* 1. • 



programs (UPP-User Participation Program and CITE-Current Information 
Tapes for Engineers) for storage and retrieval of elestrical/elec- 
tronics, and plastics information. For 1968-1969, all items pro- 
cessed in 1967 except for the Electrical and Electronics Section. 
which was discontinued in December 1967* Plastics Monthly was dis- 
continued December 1969. CQMPENDEX ( Compu terized Eng ineering I ndex ) 
began in 1969. 

"Plans for 1970 include the following projects: MONTHLY , ANNUAL, 

CARD-A-LERT (a revised and renamed Card Service), CQMPENDEX, Micro- 
film (of the ANNUAL) and several subset contracts based on CARD-A- 
LERT and COMPENDEX. An anticipated budget of $1,032,072 (including 
a small r & d grant project) is anticipated to produce (all indexed 
but not all abstracted) a minimum of 65,000 items," For 1970, items 
are processed for Monthly , Annual , CARD-A-LERT, CQMPENDEX, and 
microfilm edition of Annual. 



5.13) 
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Costs to Provide Secondary Services 
( continued) 



ERIC 



Publication 



Index Medicus 



Totalj Number 
of Abstracts Total 
or Citations Production 
Processed Cost for 
During That Year 
Year That Year ($) 



I960 125,000* 273,925* 2.19* (2.58) 



1969 230,000 — >3.76 (3.53) 



Average 
Cost per 
Abstract or 
Citation ($) 
As 1968 
Given Value 
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"In calendar 
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article . Mm 
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Finally, muel 
U,Se Governnj 
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The estimate! 
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included for 
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Table I | 

Representative Gross Costs to Provide Sec 



O 

ERIC 



(continued) 



jrage 




Comments 



i;.. 

f. (2*58) Costs include labor, equipment, supplies, printing, rentals, con- 
tract services, distribution costs. 



( 3 . 53 ) 




•'In calendar year 1969# over 230,000 articles were indexed * Some 
of these were indexed commercially at a cost of about $ 2*30 per 
article. Many were indexed by our own staff, at a per-article cost 
that appears somewhat lower, but perhaps only because it is non- 
comparable since it does not include an allocation of overhead costs. 
Finally, much of our indexing is now received at "no" cost to the 
U,S. Government, because it is received as a quid -pro-quo from in- 
stitutions having the privilege of searching duplicates of our 
tapes , , , The indexed citations are converted into machine readable 
form, partly by National Library of Medicine staff, and partly by 
a commercial contractor who charges $1,26 per citation for key- 
boarding and proofreading. The citations that are input are used 
for Index Medicus? Cumulated Index Medicus , Abridged Index Medicus , 

1? recurring bibliographies, published retrospective Literature 
Searches, as well as over 15»000 retrospective demand searches, and 
about 1,000 ”S,D,I, f s # M The indexing, keyboarding, and inputting 
costs far exceed the computer time costs, so the cost of Index 
Medicus depends primarily upon how one chooses to distribute these 
common costs among the products,*' 

The estimate of $3.76 was based on the sum of the highest unit cost 
for indexing, plus the machine input cost* No costs appear to be 
included for such things as maintenance of the subject heading list, 
overhead, computer processing, composition, printing, and distribu- 
tion* 
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ERIC 
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References 

50 

6a 



Total Number Average 







of Abstracts 
or Citations 
Processed 


Total 

Production 
Cost for 


Cost per 
Abstract or 
Citation ($) 




Publication 


Year 


During 
That Year 


That Year 
<$) 


As 

Given 


1968 

Value 




■ Kaiser Aluminum and 
Chemical Company 


1966 


2,000 


— 


7.68 


(8.23) 


In-house 
labor an< 


& Mathematical Reviews 


1963 


(13,297) 


360,000 


(27.07) 


(30.75) 


"... Mat) 
out of a 
a 1963 me 
of revieij 




1964 


13,000 


405,598 


31.20 


(34.98) 


1 




1964 


(12,570) 


312,793 


(24.88) 


(27.89) 


A publisn 
the peric 
Mathemati 
lished iic 


Q Metals Abstracts and Metals 
Abstracts Index 


1968 


23,007 


258,828 


(11.25) 


(11.25) 


Exclusive 
product id 




1969 


25,011 


(250,000) 


(10.00) 


(9.94) 


i 


^ Meteorological and Geo- 
astrophysical Abstracts 


1964 


9,000 


300,000 


33.30 


(37.33) 




X Psychological Abstracts 


1964 


10 , 500 


100,000 


9.50 


(10.65) 


i 


■ Review of Metal Literature 


1959 


12,000 


45,321 


3.78 


(4.51) 


One -third 
Costs me 
and admin 
and disti 


A Squibb Abstract Bulletin 


1951 


12,909 


23,000 


(2.17) 


(2.91) 


Weekly a| 
The cost! 
editing aj 
distributf 
include g 
include o 

4 



overhead.’ 
insofar a 
title lis 

Table I | 

Representative Gross Costs to Provide 

(continued) | 




Comments 



Refs . 



'i 

V- 

^erage 
fst per 
raet or 
;tion ($) 
1968 



Value 



(8.23) In-house abstract bulletin distributed in 200 copies. Cost includes 27 
labor and overhead, but no materials. 



(30.75) 



(34.98) 

(27.89) 



"... Mathematical Reviews incurs a deficit of nearly $200,000 a year 3 
out of a total budget of about $360,000." This report was given at 
a 1963 meeting, and assumed to represent the 1963 budget. The number 
of reviews published in calendar year 1963 was 13,297. 

12 

A published account of the financial transactions of the society for 2 
the period 1 June 1963 to May 31, 1964, reported the expenses of 
Mathematical Reviews to be $312,793.11. The number of reviews pub- 
lished in calendar year 1964 was 12,570. 



(11.25) Exclusive of overhead, but including editorial and general expenses, 
production and distribution, and administrative and other expenses. 

(9.94) 



32 

32 



(37.33) 



12 



(10.65) 12 

(: (4.51) One-third of the references are published as title listings only. 31,35 

Costs include preparation at Western Reserve University, editorial 
and administrative expenses at Amer. Soc . for Metals, and printing 
and distribution of 5,000 copies. 

(2.91) Weekly abstract bulletin distributed in approximately 350 copies. 64 

The cost figure, "... includes the labor costs for abstracting and 
editing as well as for typing, proofreading, multilithing , collating, 
distributing the bulletin, and the cost of materials. It does not 
include the labor cost for indexing of materials . . . nor does it 
include other library costs such as subscriptions to journals and 
overhead. Finally, it excludes the cost of external distribution 
insofar as it could be spearated." About half of the entries were 
title listings. 
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ERIC 



Publication 



Year 



Total Number 
of Abstracts 
or Citations 
Processed 
During 
That Year 



Total 

Production 
Cost for 
That Year 
($) 



Average 
Cost per 
Abstract or 
Citation ($) 



As 

Given 



1968 

Value 



O Technical Abstract Bulletin 


FY196S 


47,891 


587,000 


■ (12.26) 


(13.13) 


"Annual | 


and U.3. Government Research 


FY1967 


50 , 140 


601,000 


(11.99) 


(12.49) 


terly ai 


and Development Reports, and 


FY1968 


44,333 


608,000 


(13.71) 


(13.71) 


and unli 

i 

FYS 


Indexes 


FY1969 


45,923 


674,000 


(14.68) 


(13.80) 


f 












FY0 

fy| 

fy| 

1 

Annual!^ 

issues ri 

s 

averages 


£) USGRDR and USGRDR-Index 


1968 


37,106 


246,000 


22.00 


(22.00) 


Tt 0ur cos 
eludes e 




1969 


35,788 


191,000 


— 


— 


checking 
and abstj 
the anno 














above p| 
$8 .50 f| 














eluded jj 

■St 

the repd 



cases an 



and comj| 



necessaij 



mately 
ting an | 



The cost] 
USGRDR-l] 



Titles 



o 

ERIC 
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Representative Gross Costs to Provide 

(continued) 



Comments 



Refs . 



srage 

3t per 

2 

ract or 
ulon ($) 

L 1968 
r Value 



(13.13) 

(12.49) 

(13.71) 

(13.80) 



"Annual costs for publication of TAB and Indexes including Quar- 
terly and Annual Indexes and the cost of announcing unclassified 
and unlimited documents in the USGRDR were: 



FY66 


$587,000 


(47,891 


items 


announced) 


FY67 


601,000 


(50,140 


items 


announced) 


FY68 


608,000 


(44,333 


items 


announced) 


FY69 


674,000 


(45,923 


items 


announced) 



( 22 . 00 ) 



Annually there are 24 issues of TAB, TAB Indexes, and USGRDR; three 
issues of Quarterly Indexes; and one Annual Index. Copy production 
averages 5,000 each. M 

"Our costs are usually based on the complete input cycle which in- 
cludes examining the document for reproducibility and missing pages, 
checking for duplicates, descriptive cataloging, subject indexing, 
and abstracting. We would then keyboard the data for publication in 
the announcement journal. The cost per document involved in the 
above processing would amount to approximately $13.50 direct plus 
$8.50 for overhead. In most cases, abstracting costs would be in- 
cluded in the above costs as we are fortunate that over 90 percent of 
the reports we process have author abstracts. These are used in all 
cases and are only modified to meet certain criteria such as length 
and conversion symbols for acceptance by the computer. If it is 
necessary to write an abstract separately, the cost would be approxi- 
mately $8.00 direct plus $5.00 overhead. This cost is based on wri- 



16a 



ting an average of six to 


seven abs 


tracts 


The cost of preparation, 


production 


, and i 


USGRDR- Index is as follows: 






(in thousands) 




1969 


1968 


Preparation 


$ 82 


$137 


Production 


85 


85 


Distribution 


24 


24 


Total 


$191 


$246 


Titles announced 


35,788 


37,106 
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Total Number 
of Abstracts 
or Citations 
Processed 


Total 

Production 
Cost for 


Average 
Cost per 
Abstract or 
Citation ($) 




Publication 


Year 


Dui’ing 
That Year 


That Year 
($> 


As 

Given 


1968 

Value 


$ 

-v! 


0 Tobacco Abstracts 


1967- 68 

1968- 69 


2,148 

3,182 


40 , 148 
45,082 


(18.69) 

(14.79) 


(18.69) 

(13.90) 


i 

Total c; 

1 

•a 


(Unnamed) 




1964 


10,000 




10.67 


(11.96) 


.3 

Hypothe 
This ill 
ing, su 
For thi 
notes £ 


b (Unnamed) 




1964 


1,000 




11.33 


(12.70) 


Private, 
bulleti; 
as abs*d 
printin 

j 


(Unnamed) 




1964 


— 


— 


4.40 


(4.93) 


Private 


(Unnamed) 




1961 






10.00 


(11.64) 


n A gene 
or inde 
at leas 
ized se 
ument . | 
Eightee 
for one 
U.S. se 
about $ 


(Unnamed) 

t 




1966 






30.00^ 

7.50 2 


(32.13) 

(8.03) 


"The cl 

eluding 

an iten 

report e 

are bas 
' . % 
organi| 


(Unnamed) 
^ Abstract 


2 

Title only. 


1961 

3 

Index or citation entry. 


30.00^ 

10 . oo 3 


(34.92) 

(11.64) 


Thi s re 

informs 

i 

cost pc 

entry \ 

.3 
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| 1968 

% Value 

.l " 1 — ~~ 

l: 

|" (18.69) 
r (13.90) 



Comments 



Total costs for preparation, distribution, production. 



References 

44 

44 



| (11^96) Hypothetical abstract bulletin with 500 copies distributed weekly. 25 

| This includes many factors such as subscriptions, abstracting, edit- 

|. ing, supervising, indexing, typing, printing, mailing, and overhead. 

I For this hypothetical bulletin, the author cites Ben Weil*s lecture 

f: notes for Columbia and Rutgers. 

| (12,70) Private communication to Friedenstein, describing costs of an abstract 25 

l bulletin with 1,200 copies distributed quarterly. Cost factors such 

f: as abstracting, editing, supervising, indexing, typing, royalties, 

$; printing, mailing, and overhead are included. 



(4.93) Private communication to Friedenstein. 



I (11.64) 



(32.13) 

(8.03) 



r (34.92) 
£(11 .64) 



"A general average of $10 per document processed (either abstracted 
or indexed or both) seems to be a reasonable estimate of unit costs, 
at least for the major U.S. services. Some of the smaller, special- 
ized services are known to have costs as high as $30 to $50 per doc- 
ument. Unit processing costs have doubled in the last 12 years. 
Eighteen U.S. services, with budgets totaling $7 million accounted 
for one-third of the two million documents processed in 1961 by 288 
U.S. services in all scientific fields, making the average cost 
about $10 per document . ** 

’’The cost data suggest an average cost of $30 for an abstract in- 
cluding the bibliographic citation and an average cost of $7.50 for 
an item that is indexed but not abstracted. The average unit costs 
reported here are rough , estimates. The data on which these estimates 
are based are extremely poor and do now allow comparisons between 
organization categories or between individual organizations/’ 

This report and a subsequent book version, reference an NSF/OSIS 
informal document, and say, ”NSF states that for 1961 the estimated 
cost per abstract is $30 and the estimate for an index or citation 
entry was $10 , M 



25 



53 



71 



12,70 
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Sample Size 

Used as Average 

Basis for Processing 

Bate This Report Rate 
of (number of (abstracts/ 
Organization Sample abstracts) man-day) 



O American Oil Company 1960 15,000/yr. 4-8 



Average 
Cost per 
Abstract ($) 



As 

Given 



1968 

Value 



5.80- (6.83-) 

8.00 (9.42) 

6.20- (7.30-) 

8.20 (9.65) 



j 



3 

Tf An English; 
patents, rai 
about $3.80^ 
for literati 
is $6.20 to^ 
ents, paperj 



□Arthur D. Little, Inc. 1952 1,000 — 250.00 (327.00) Total contra 

on this pro; 
literature c 
tr acted at | 
1000 . Divii 
mately $2501 

"Of these f: 

■* 

report extri 
basis of coi 



0 Br itish Scientific In- 
strument Research 
Association 


1950 


2,461 




1.26* 


(1.82) 


. . the col 
and indexing 
1950 shiilil 


A David Brown Indus- 
tries, Ltd. 


1960 


640 




(0.43) 


(0.51) 


"The cost q| 
the total c| 
also the rej 
original aba 
for typing,! 
A 1960 shill 


^ Eli Lilly and Company 


1953 


8,320 


— 


1.50 


(1.95) 


In-house abj 



spent by abl 
ical proces 



jig i 

Includes both abstracting and indexing efforts. 

** Assume 2000 man-hours per man-year. 1 

() Figures computed by the investigators , based on the reported data. i 

Table II i 



Rates and Costs Reported for thSI 

1 






Comments 



3-) 

2 ) 

P-) 

5) 



| 

P> 



"An English-language patent can be abstracted in an hour or two." ,f . . . for 
patents, raw abstracts cost between $2.00 and $5.00, and the effort costs 
about $3.80. The total cost, then, ranges from $5.80 to $8.80. Similarly 
for literature, raw abstracts cost between $1.00 and $3.00, and the effort 
is $6.20 to $8.20. Excluded in these figures are costs of journals, pat- 
ents, paper, ink, machines, and equipment." 

Total contract cost is divided by the total number of reports "extracted" 
on this project by A. D, Little to establish a punched card file on the 
literature of explosives for Picatinny. "The total number of reports ex- 
tracted at present is about 900 and the final figure should not exceed 
1000. Dividing this by the total cost gives a cost per report of approxi- 
mately $250." Other estimates were computed on the basis of other factors. 
"Of these figures, the one based on the total project — ... $250 per 
report extracted -- are the most reliable, and are the ones used as a 
basis of comparison and analysis below." (Ref. p. 30) 



2 ) 



1 ) 



>5) 



"... the cost of making the abstracts, classifying, proofreading, editing 
and indexing is about 5s. 8d . per abstract (9s. including overhead). A 
1950 shilling was assumed to equal 14 cents. 

"The cost quoted for an abstract (ls.5d.) is somewhat misleading in that 
the total costs cover preparation and typing of original abstracts and 
also the reproduction of published abstracts. A more exact figure for the 
original abstract would be, perhaps, 3s. 6d. for the preparation plus Is. 
for typing, and for the copying of a published abstract 9d , for typing." 

A 1960 shilling had a value of 12 cents. 

In-house abstract bulletin. "A recent cost survey which included time 
spent by abstractor, library staff, and departments responsible for mechan- 
ical processing resulted in an estimated $1.50 per abstract." 
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45 





Date 


Sample Size 
Used as 
Basis lor 
This Report 


Average 

Processing 

Rate** 


Average 
Cost per 
Abstract ($), 


i 


Organization 


of 

' Sample 


(number of 
abstracts) 


(abstracts/ 

man-day) 


As 

Given 


1968 
Val ue 




Qfisso Research and 
Engineering Company 


1960 


-- 


— 


4.00- 

7.00 


/ 

(4.70- 

8.24) 


"Similarly, a ; 
$7, exclusive- 


Q ici 


1966 




8-16* 


2.80* 


(3 .00) 


Indicative abl 
keywords are | 
prepared . Aui 
by the abstrac 
£l, of which a 
and allocating 
of half an hoi 


O Kaiser Aluminum and 
Chemical 


1966 


2,000 


— 


7,68 


(8.23) 


Cost per absti 
pare in-house \ 


Knolls Atomic Power 
Laboratory 


1964 


9,000 


8* 


4.00* 


(4.48) 


r, The average c 
the system lit 
labor costs fc 
each) , Comput 
terms are assx 

; 


& Plastics Technical 
Evaluation Center 


1963- 

1964 


1,920 




8.20 


(9.26) 


A 5 x 8 abstrai 
abstract cornea 
cost breakdown! 
without sped 3 
given for all* 




1963 


1,000 




(12.68*) 


(14 . 04 ) 


’’Briefly, thii| 
indexed under^J 
attempt was raa® 
alphabetized , m 
separate voluiiS 
$32,680) , macfi 
to $20 . 50 per| 
(ref * p. 192)1 
(ref , p. 195 ) ] 

f! 
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Comments 



Ref. 



Sr 

t ($) 
|1968 
lvalue 



?(4 .70- 
| 8.24) 

1(3.00) 



(8.23) 



(4.48) 



(9.26) 



(14.04) 



"Similarly, a program at Esso Research and Engineering Company costs $4 to 46 
$7, exclusive of the expense of maintaining a reference pool of abstracts.” 



Indicative abstracts of new reports are prepared, and an average? of 15-20 
keywords are assigned to each report. M An eight to ten- line abstract is 
prepared. Author’s summaries are taken into account, but not relied upon 
by the abstractors . . . the average cost of indexing a report is approximately 
=£l, of which about 15s. represents technical effort in reading, abstracting, 
and allocating keywords; this figure excludes overheads (f . An indexing time 



of half an hour to an hour is usual 



The 1966 £ had a , value o $2.80= 



Cost per abstract (including labor and overhead, but ,no materials) to pre- 
pare in-house abstract bulletin and distribute in 200 copies. 

i ‘ ! 

"The average cost to prepare the unit record f^r a document and place it on 
the system library tapes is about $4.00, which consists primarily of direct 
labor costs for professional and clerical efforts (less than 30 minutes 
each). Computer costs are virtually nil.” (ref. p. 182) An average of 12 
terms are assigned to each document. (ref. p, 178) 

A 5 x 8 abstract card is prepared, but no mention is made of where the 
abstract comes from. "Indexing rate averages 2-7/8 document per hour.” A 
cost breakdown for abstracting 1,920 documents showed a unit cost of $8.20, 
without specifying what was included in that figure. A total of $15.00 was 
given for all input processing and index production. 

"Briefly, this index covers about 1,000 documents, each document being 
indexed under about 15 terms ... No master vocabulary was used, but an 
attempt was made to be consistent in assigning index terms. Terms were 
alphabetized, arranged, and printed by machine ... Abstracts are bound in 
separate volumes . The costs of abstracting and assigning coordinate terms 
$32,680) , machine indexing ($5,350), and reproduction ($2,300) worked out 
to $20.50 per document, which was believed to be exceptionally low." 

(ref. p. 192) "... our indexing rate averaged 2-7/8 documents per hour." 

(ref. p. 195). 



28 



27 



61 
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!r o 

I ERIC 



Organization 



^ U.S.Dept.of Commerce 
Clearinghouse for 
Federal Scientific 
and Technical 
Info rmation 



Western Reserve Uni- 
versity 



O Wyeth Laboratories 



ERIC 

hfliflaffHHaaaa 



Date 

of 

Samnle 



Sample Size 
Used as 
Basis for 
This Report 
(number of 
abstracts) 



Average 



Processing 

Rate** 



Average 
Cost per 
Abstract ($) 



(abstracts/ 

man-day) 



1968- 

1969 



6-7 



1960 33,000 



1961 36,000 



1962 4,000 



1964 2,500 est. 



He 

(10 ) 



As 

Given 



1968 

Value 



13.00 (13.00) 



6.50* (7.65) 



6 .49 



(7.55) 



6 ; 50- 



7 . 50 



(3 . 55* ) 



(3.80) 



"if it is m 
approximate 
writing an 



Total proje 
per unit co’ 
abstract wa 
quality con; 
chine proce 
fringe bene 
of the subp 



Summary unijl 
ence since 
editing, ah) 



supervision^ 
fits, 20% c i 



processes . 



(7.48-) 

(8.63) 



Estimates o; 
documents, I 
employee bej 
tion of a pj 



Writing anc 
this is $7,1 
mated at and 
. . . are $57| 
to another 
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Comments 



Ref 



i 

V 
t 

f 

:e 
ir 

: ($) 

L968 
Talue 

I 

13.00) If it is necessary to write an abstract separately, the cost would be 
approximately $8.00 direct plus $5.00 overhead. This cost is based on 
? writing an average of six to seven abstracts per day. 11 



(7.65) Total project input costs for a 13 month period were $239,345. The total 

l per unit cost experienced to prepare both a conventional and telegraphic 

je abstract was $6.50. This includes acquisitions, abstracting, editing and 

K quality control, liaison activities, code making, automatic encoding, ma- 

chine processing, supervision, equipment, supplies, subscriptions, 4% 
fringe benefits, and 15% overhead. The costs are reported in detail for all 
{ of the subprocesses. 

(7.55) Summary unit input cost is $6,492 for more than a year of additional experi- 

L ence since the last cost report. This includes acquisitions, analysis, 

editing, and quality control, liaison, code making, automatic encoding, 
supervision, computer processing, supplies, subscriptions, 5% fringe bene- 
i fits, 20% overhead rate. The costs are reported in detail for all the sub- 

: processes. 

(7.48-) Estimates of costs of projected system, with input volumes of 5-20 thousand 
(8.63) documents, including all personnel (except the systems manager), equipment, 

employee benefits, and overhead. This estimate was based on prior WRU opera- 
tion of a pilot system with 4,000 documents. 

(3.80) '’Writing and indexing abstracts required one man-year. 11 On a salary basis 
this is $7,000, however benefits and other overhead charges can be esti- 
mated at another $1,000 ... Machine costs are $720 per year. Card costs 
... are $57.60. Other paper supplies, filing cabinets, space rental amount 
to another $100." 

Table II 

iported for the Abstracting Process 
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r 



o 

ERIC 



16a 



55 



54 



57 



19 



Organization 



() ^unspecified average 
for Germany) 



(hypothetical abstract 
bulletin) 



A (unspecified) 







Sample Size 



Used as 
Basis for 
Date This Report 
of (number of 
Sample abstracts) 



Average 

Processing 
_ , H*Hc 

Rate 

(abstracts/ 

man-day) 



Average 
Cost per 
Abstract ($) 



As 

Given 



1968 

Value 



1958 



(2 . 33* ) 



(2.81) "The following cost 
studies and compari 



Preparation of a| 
bibliographic soil 

Preparation of tf 
subject index | 



Preparation of a| 



abstract or whatef 

_s 

selection 3 



Cost of classify: 
or in another sy 



4.3 DM equals one d 



1964 



2.88 



(3.23) Costs are postulate 
process is estimate 
supervision, typing 



1964 1,000 



2 ; 50 * 



(2.80) Costs are based on| 
stracts per year, 
editing, and supei 
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•age 
} pe x* 
let ($) 
f 1968 

| Va". Comments 



(2,81) "The following costs, which were obtained through thorough and reliable 
studies and comparisons, may be considered average for Germany: 







f; 



Preparation of a bibliographic card with title and 
bibliographic sources of a publication 

Preparation of the same bibliographic card with added 
subject index 

Preparation of a bibliographic card containing an 
abstract or whatever facts are needed for mechanical 
selection 

Cost of classifying a title in decimal classification 
or in another system 



1.00 DM. ($0.23) 

3.00 DM ($0.70) 
10.00 DM ($2.33). 

1.0 DM ($0.23) 



4.3 DM equals one dollar" 



i 



(3.23) Costs are postulated for a hypothetical abstract bulletin. The abstracting 
process is estimated to cost $2.88 per abstract, excluding subscriptions, 
supervision, typing, and overhead costs. 

(2.80) Costs are based on an actual abstract bulletin that publishes 1,000 ab- 
stracts per year. The $2.50 includes both abstracting and indexing, 
editing, and supervision. This cost excludes typing and overhead costs. 
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Costs of the Abstracting Process 
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Costs of the Abstracting Process 
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Fig. 11-3 

Abstracting Rates 
(As a Function of the Year) 





Date 


Sample Size 
Used as 
Basis for 
This Report 
(number of 


Average 

Processing 

Rate 

(indexed 

articles 


Average 
Cost to 
Index Each 
Report or 
Article ($) 


: 


Organization 


of 

Sample 


reports or 
articles) 


or reports/ 
man -day) 


As 

Given 


1968 

Value 


^ Aeronutronics 


1961- 

1963 


10,000 


10.1 


2.99* 


(3.44) 


i 

Average 9.2 s 
trex equipmeri 
Total costs , | 
tization was ! 
report. '1 


©American Institute of 
Chemical Engineers 


1961 


— 


(12.0) 


— 




"For the AICHi 
average about! 


o American Meteorological 
Society 


1958 


7 bibliog- 
raphies 


— — 


0.51- 

2.33 


(0.61 

2.81) 


Costs experiei 
in size from 3 
tion, indexing 


• Arthur D. Little, Inc. 


1952 


1,000 




250.00* (327.50) 


Total contrac| 
on this projeo 
literature of| 
tracted at pre 
1,000. Divide 
imately $250. J 
tors. M 0f the 
per report exj 
basis of compa 


“C^Biological Abstracts 


1955 


30,000 


— 


* 

6.38 


(8.28) 


"Today , and f J 
abstract publii 



$1 . 33 for e 
1.40 for c 
2.20 for i 
.82 for | 
. 28 for 1 
.35 for i 
■j 

M ... about 50$ 

* 1 

Includes both indexing and abstracting effort. ij 

* Assume 2,000 man-hours per man-year, | 




Table III 

Rates and Costs Reported for the 



Comment s 



Ref 



;h 



1968 

Value • 

[3.44) Average 9.2 subject access points/document, processed for input to Terma- 41 
l trex equipment. Descriptors selected from Thesaurus of ASTIA Descriptors. 

Total costs, including labor and benefits, supplies, and equipment amor- 
tization was $29,922 for 10,000 documents. Average 47.43 man-minutes per 
report . 

"For the AICHE Journal . . . the work is done by graduate students who 26 

average about 40 minutes per article." 

:0.61 i Costs experienced in the compilation of 7 special bibliographies, ranging 58 

2.81) ■ in size from 100-224 citations, with differing degrees of editing, annota- 
P tion, indexing, and distribution. 



17.50) i Total contract costs are divided by the total number of reports "extracted* 
| on this project by A . D. Little to establish a punched card file on the 
literature of explosives for Picatinny. "The total number of reports ex- 
tracted at present is about 900 and the final figure should not exceed 
1,000. Dividing this by the total cost gives a cost per report of approx- 
imately $250." Other estimates were computed on the basis of other fac- 
tors. "Of these figures, the one based on the total project — ... $250 
per report extracted — are the most reliable, and are the ones used as a 
basis of comparison and analysis below." (ref. p. 30) 



68 



;8.28) 



"Today, and for the remainder of 1956, 
abstract published will cost 



we are reasonably sure that each 16 



$1.33 for editing 

1.40 for composition and proofreading 
2.20 for printing and binding 
.82 for index editing 

.28 for index composition and proofreading 
.35 for index printing and binding.** 

. . about 50% of our abstracts are written by volunteer abstractors. 
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Date 

of 

Sample 



Sample Size 
Used as 
Basis for 
This Report 
(number of 
reports or 
articles) 



Average 



Processing 

Rate** 



(indexed 
articles 
or reports/ 



Average 
Cost to 
Index Each 
Report or 
Article ($) 



As 



1968 



man-day) Given 



Value 



-^^-British Scientific 
Instrument Research 
Association 



1950 



2,461 



(1.26) 



Bureau of Ships 



1963- 

1964 



218 



(15.6) 
for index- 
ing 



[J Chemical Abstracts 
Service 



1964 



9°, 000 



(7.11) 

est 



(7.97) 



^ Chemical-Biological 
Coordination Center 



1953- 

1956 

1955 



29.46 
50 .00 



(38.50) 



(64.90) 



♦ Cranfield 



1959 



(24.0) 



(1.82) " 



the cost oj 



and indexing, il 



1950 shilling wi 



Coordinate inde3 



iod, 218 report* 



documents per mi 
it was necessarj 



mg rate, not ir 
per man-hour. 1 



per hour could i 
better code bool 



This data was or 
index to Chemicj 
or abstracting c 
labor types in t! 
1964). Assumptl 
ciated with the! 
be $7.11 per abl 



f "'I 

"Accurate cost 1 

■g 

cost per article 
number of code l 
fiscal year 195! 



"it appears froi 
general collect;] 
been taken to bt 
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ERIC 



(continued) 



I 



e 

o 

ch 

r 

5) 

1968 

7alue 

L 

I 1 - 82 ) 



I' 



(7.97) 



58 .50) 
54 . 90) 



Comments 



"... the cost of making the abstracts, classifying, proofreading, editing, 
and indexing, is about 5s. 8d. per abstract (9s. including overhead) . " A 
1950 shilling was assumed to equal 14 cents. 

Coordinate indexing with links and roles. "During the last indexing per- 
iod, 218 reports were indexed in 112 man-hours, for an average of 1.95 
documents per man-hour." (BuShips ref. p. 3). After subject indexing, 
it was necessary to convert the descriptors to computer codes. "The cod- 
ing rate, not including supervision or checking, averaged 4.32 documents 
per man-hour." (BuShips ref. p. 6). "The coding rate of 4.32 documents 
per hour could be improved, even with the same general procedures, if 
better code books were available." (BuShips i*ef . p. 20). 

This data was only for the production of a single subject and formula 
index to Chemical Abstracts, and does not include any of the acquisition 
or abstracting costs. This article reports the time required by all 
labor types in the production of the indexes for Vol . 60 (Jan. -June 
1964). Assumptions were made for this summary regarding salaries asso- 
ciated with these reported man-hours, and a total unit cost estimated to 
be $7.11 per abstract, just to produce the indexes. 

"Accurate cost studies were never conducted. One estimate placed the 
cost per article processed at $29.46. ... A second estimate based on the 

number of code sheets completely processed and released for filing during 
fiscal year 1955 placed input costs at ... $50.00 per article." 

"it appears from personal discussions that an average of 20 minutes for a 
general collection of technical reports is the top limit, and this has 
been taken to be the maximum indexing time to be used in the project/ 1 



Ref * 
29 



30, 

39, 

74 



77 



18 



15 
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Date 

of 

Sample 



Sample Si'ze 
Used as 
Basis for 
This Report 
(number of 
reports or 
articles) 



Average 



Processing 

Rate 



(indexed 
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Average 
Cost to 
Index Each 
Report or 
Article ($) 



As 
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1968 

Value 



O Defense Documentation 1969 
Center 



50 , 000 



6.37 



(5.99) 



Q DuPont 


1958 


250 


(2.4) 


(36.00) 


(43.38). 




\ 

19>59-60 


2,100 


(4.0) 


(29.52) 


(34.75) 




1960-62 


5,000 




(21 .40) 


(24.91) 



I 



"Unit costs pe 
lowing perfoi-ra 



Analyze a 
Review ail 
Catalog ^ 
Review tl 

iJ 



Edit ancE| 



Our document 8 
reports Costs 
analyzing, inf 
data . " 



For this revic 
represent thej 
duct ion of thj 



"That was our 
months of indc 
chemical engii 

"This broaden! 
January 1959 
spent a total' 



Indexing of at 
and finished 



I 



by 3 girls, wlj 



Table III 



Rates and Costs Reported for the Index:! 
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k 

•a 

| to 

I Each 

it or 

is ($) 

| 1968 

F Value 



Comments 



R ei 



(5.99) 



I (43.38). 



| (34,75) 



"Unit costs per title, based upon DDC’s engineered standards for the fol- 
lowing performance elements are: 



Analyze and abstract 


$5.38 


Review analysis and^hsarract 


.99 


Catalog documents 


6.33 


Review titles cataloged 


1.01 


Edit and review 


3.91 



Our document contributors prepare and submit to us an abstract with their 
report#* Costs which DDC categorizes as ’’Analyze and Abstract" include 
analyzing, indexing, categorizing , coding, revising, and/or annotating 
data . " 

For this review, it was assumed that the sum of the first two costs would 
represent the full cost of the indexing process. The full cost of pro- 
duction of this service is about twice this cost. 

"That was our pilot run... It contained 250 reports and required 5 man- 
months of indexing time for a graduate chemical engineer and a Ph.D. 
chemical engineer at a cost of $9,000." 

"This broadened information system involving 2,100 reports was begun in 
January 1959, and finished in June 1960. It involved 125 indexers who 
spent a total of 25 man-raonths and we estimate the total cost at $62,000.’ 



21 



21 



1(24.91) Indexing of about 5,000 plastics patents. "The job was begun in June 1960 21 



l and finished in March 1962. It cost $107,000. 

5' by 3 girls, who were chemists." 
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All this indexing was done 



o 

ERIC 





Date 


Sample Size 
Used as 
Basis for 
This Report 
(number of 


Average 

Processing 

_ . 5 

Rate 

(indexed 

articles 


Average 
Cost to 
Index Each 
Report or 
Article ($) 


Organization 


of 

Sample 


reports or 
articles) 


or reports/ 
man-day) 


As 

Given 


1968 

Value 


O E . I . du Pont de 
Nemours & Co . 












System A 


1964 


5,000 


(5.8) 


(15.10) 


(16.93) 


System B 


1964 


811 


(8.0) 


— 




System C 


1964 


5,000 


— 


(4.00) 


(4.48) 



1 ERIC Clearinghouse on 
Early Childhood 
Education 



1967-68 



1,500 



. 12 . 00 - 

15.00 



( 12 . 00 - 

15.00) 



Geoscience Abstracts 



1964 



6,326 



(80-160) 



{0 .63) 



"Both systems i 
of chemical prc 
terms per docun 
age depth of 7C 
roles, whereas] 



cabulary contrc 



vision for tree 
and generic pos 



used no vocabu] 



"input costs fc 



per patent for* 



clerical time s 
computer updati 
eluding about E 
of clerical tin 



"Processing off 



(0.71) "With experienc 



. . . This is ap| 
index entries. 



1 



ing or of assig 



ing operations) 



eluding supplie 



and editing, cc 
siderably lessS 

i 
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ERIC 



age 

to 

3ach 

or 



b ($) 
1968 



Value 



Comments 



(16.93) "Both systems used concept coordination, with System A indexing the names 
of chemical processes, properties and equipment to an average depth of 90 
terms per document . . . System B indexed the names of chemicals to an aver- 
(4.48) age depth of 70 terms per patent ... System A used links and a set of 11 
roles, whereas System B used no links and 5 roles. System A employed vo- 
cabulary control by using Chemical Abstracts T system of nomenclature, pro- 
vision for treatment of nonchemical terms for synonyms and near synonyms 
and generic posting of both chemical and nonchemical terms. System B, ... 
used no vocabulary control/ 1 

"input costs for System A include a little over one hour of technical time 
per patent for indexing and vocabulary editing, about half an hour of 
clerical time and 3 dollars pe^ patent for keypunching, tabulating, and 
computer updating costs. Syt » C input costs are considerably lower, in- 
cluding about 5 minutes of ah ^acting and indexing time plus a half hour 
of clerical time. No machine costs are involved for C." 



(12.00- "Processing of documents costs between $12-15 per document/' 
15.00) 



(0.71) ''With experience, one person can index from 10 to 20 documents per hour. 

. . . This is approximately the same effort given to assigning traditional 
index entries." (ref. p. 14). Not including the cost of final print- 
ing or of assigning UDC numbers (which is considered a part of abstract- 
ing operations) the first full subject index to Geoscience Abstract s, in- 
cluding supplies, keypunching, programming, computer time, proofreading 
and editing, cost about $4,000. Succeeding years 1 costs averaged con- 
siderably less." (ref. p. 15). 
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Ref 



47 



11 



60 



Organization 



Date 

of 

Sample 



Sample Size 
* Used as 
Basis for 
This Report 
(number of 
reports or 
articles) 



Average 

Processing 

_ , >r.>< 

Rate 

(indexed 
articles 
or reports/ 
man-day) 



^ IBM British Labora- 
tories 



1962 



2,000 



^ICI 



1966 



.^Knolls Atomic Power 
Laboratory 



1964 



9,000 



8 est , 



I Linde Co . 

> Monsanto Chemical Co. 



1959 

1962 



2 333 
8,500 



(47.2) 



Average 
Cost to 
Index Each 
Report or 
Article ($) 



As 

Given 



1968 

Value 



— 


(0.70) 


(0.81) 


For 


indexing] 




(manual 

UDC) 

(0.28- 


(0.32- 




Convent! 
KWIC inc 
KWIC in| 




0.49) 
KWIC in- 
dexing 


0.56) 


No 

of 


supporting 
$2.80. 1 

1 


-16* 


2.80* 


(3.00) 


Indicative at! 



keywords arej 
prepared . . .§ 
by the abstrs 
mately^l, p| 
abstracting 
: £n indexing t 
\ value of $2.' 



4.00 



(4.48) 



"The average 1 
on the syste: 
direct labor; 
minutes each 
average of 



63.50 (75.82) 

0.39 (0.49) 



Costs includ 



Three colle 
were assigne 
. . . during t 
dexing was 
actual time : 
rate was 5.£ 
$2.31 per he 
and abstrac 
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O 

ERIC 



Comments 



Ref> 



ge 

to 

Each 
or 
($) 
1968 
j Value 



(0.81) 



(0 . 32- 
: 0.56) 



I (3.00) 



For indexing 2,000 documents, the following costs are given: 

g 500 
4 200 
£ 350 

No supporting evidence is given for these costs. The 1962^ had a value 
o'l $2.80. 



Conventional UDC indexing 

KWIC indexing on an in-house computer 

;<WIC indexing on a data center computer 



Indicative abstracts of new reports are prepared, and an average of 15-20 28 

keywords are assigned to each report. "An eight to ten-line abstract is 
prepared ... Author’s summaries are taken into account, but not relied upon 
by the abstractors ... the average cost of indexing a report is approxi- 
mately^!, of which about 15s. represents technical effort in reading, 
abstracting, and allocating keywords; this figure excludes overheads ... 

An indexing time of half an hour to one hour is used ... The 1966 gf had a 
value of $2.80. 

"The average cost to prepare the unit record for a document and place it 61 

on the system library tapes is about $4.00, which consists primarily, of 
direct labor costs for professional and clerical efforts (less than 30 
minutes each). Computer costs are virtually nil . n (ref. p. 182). An 
average of 12 terms are assigned to each document. (ref. p. 178). 

I' 

[(75.82) Costs include labor and machine rental. 78 



(4.48) 



(0.49) "Three college juniors who both completed 3 or more years of chemistry ... 

were assigned the task pf indexing ... they actually indexed 3.500 reports 
... during the summer at a direct cost of $3,328, or $0.39 per report. In- 
dexing was carried to an average depth of 12.2 locators per report ... the 
actual time required for the indexing was 1440 hours. The average indexing 
rate was 5„9 reports per hour . . . 11 (The quoted labor cost is equivalent to 
$2.31 per hour.) All of this indexing was done from the report announcement, 
and abstract. 



43 
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ERIC 



Qrgcni zatior. 



A Monsanto Chemical Co. 
(continued) 



0 Nationaal lluchtvaart 
laboratorium (Holland) 



ft** NLM 



p* Patent Office 







Sample Size 
Vsed as 
Basis for 
This Report 
Date (number of 
of reports or 

Sample articles) 



average 
Processing 
Ra te 
(indexed 
articles 
or reports/ 
man -day) 



Average 
Cost to 
Index Each 
Report or 
Article ($) 



As 

Given 



1968 

Value 



1962 



(16.0) 



1959 



1960 



125,000 



(5.3) 



(37.0) 



2.25 (2.59) "indexing in di, 

the report ann^ 
aging 23.2 ter 
per hour ... S 
average $2.25 * 

j 

"Few reliable \ 
particularly li 
ports for the \ 
lluchtvaart lal 



(0.67) 



(0.79) 



1968 

1969 



40-50 



230,000 



1962 



1963 



60,000 



201 



( 2 . 5-7 . 5 ) 



For the 1960^ Ir 
ing totaled $ol 
year. This cos 
services. Thiq 
articles, thisl 



, ~ ... an experi 

2.50 (2.35) ”l n calendar y 

were indexed cc 
indexed by ourij 
but perhaps onl 
allocation of a 

i 

12.00 (13.80) approximately; 

approximately \ 

The 1963 repor‘ 
minutes) for s 

single ans 
double a: 
triple am 
single an: 
double ans 

This is the con: 
The 64.6, 128.6 
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Comments 



Ref 



f 

| 

i 

e 

ach 

or 

($) 

1968 

Value 

r 

(2 . 59) 



(0.79) 

I 



(2.35) 



L3.80) 



"Indexing in depth directly from the reports is slower than indexing from 43 
the report announcement, requiring from 30-40 minutes per report and aver- 
aging 23.2 term-roles per report. The average time has been two reports 
per hour ... Since higher paid technical employees are required, the costs 
average $2.25 per report indexed ..." 

"Few reliable figures have been given for current practices, although a 15 

particularly high figure is the 1% hour average quoted for indexing re- 
ports for the catalogue of aerodynamic data prepared by the Nationaal 
lluchtvaart laboratorium in Holland.' 1 

For the 1960 Index Medic us the unit costs for indexing and indexing assist- 50 
ing totaled $0.67 per article, based on a volume of 125,000 articles per 
year. This cost included labor, equipment supplies, rentals, and contract 
services. This was done with 13.5 personnel positions. For the 125,000 
articles, this leads to an estimate of 37.0 items per man-day. 

". . . an experienced indexer at NLM will index 40 to 50 articles per day." 38 
"in calendar year 1969, over 230,000 articles were indexed. Some of these 6a 

were indexed commercially at a cost of about $2.50 per article. Many were 
indexed by our own staff, at a per-article cost that appears somewhat lower, 
but perhaps only because it is non-comparable since it does not include an 
allocation of overhead costs." 

"Approximately 60,000 patents are reclassified annually at a total cost of 76 
approximately $12.00 per patent.” 

The 1963 report gives the following average patent indexing times (man- 9, 

minutes) for several modes of operation: 36, 



single 


analyst 


64.6 


double 


analyst 


128.6 


triple 


analyst 


193.2 


single 


analyst/reviewed 


111.6 


double 


anal yst/reviewed 


183.5 



This is the combined data for both experienced and inexperienced analysts. 
The 64.6, 128.6, and 111.6 figures were repeated in 2 later publications. 
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of 
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Used as 
Basis for 
This Repoi't 
(number of 
reports or 
articles) 


Average 
Processing 
Rate 
(indexed 
articles 
or reports/ 
man-day) 


Average 
Cost to 
Index Each 
Report or 
Article ($) 

As 1968 

Given Value 


1 


Pesticides Information 
Center 


1965 


— 


(17.0-20.5) 


— 




1 

For a propo; 
hours per i- 
tors, proof: 
p. 8). Thi 

i 


^Picatinny Arsenal 


1956 




(19.0-40.0) 


0.69 

0*32 


(0.88) 

(0.41) 

•». 


The catalog: 
hours/ unit j 
forms; chec: 
tin of repo: 
eluded are ] 
internal re 
40.0 for ex 


£ Plastics Technical 
Evaluation Center 


1963“ 

1964 


3,370 


(23.0) 


4.90 


(5.49) 


M Re ports ar 
recall of tl 
ment . " Ter] 
indexes to yl 
$4.90 fdr 
for all Inp; 
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1968 

Value 



Comments 



For a proposed system, bibliographers* time is estimated to be 0.17-0.25 
hours per item. To this time must be added the supporting efforts of edi- 
tors, proofreaders, and 0.22 hours per item of typist time. (ref. Sect. B, 
p. 8). This adds up to a total of at least 0.39-0.47 man-hours per item. 



(0.88) The cataloging standard .or incoming reports to this library says 0.429 
(0.41) hours/unit "includes time necessary to: obtain reports; remove attached 



forms; check distribution; fill out form X or Y; cataloging; typing bulle' 
tin of reports and secret reports, and file cards for reports Also in- 
cluded are allowances for personal time.** Standards given for Uniterming 
internal reports were 0.201 hrs/unit. This results in rates of 19.0 and 
40.0 for external and internals reports, respectively. 



(5.49) "Reports are given to the indexer who reviews the terms necessary to insure 



recall of the document. To date, this has averaged 4 or 5 terms per docu- 
ment.” Terms are keypunched, posted to a computer file, and used to print 
indexes to the file. "Indexing rate averages 2-7/8 documents per hour." 
$4.90 for the indexing process, $8.20 for the abstracting process, $15.00 
lor all input processing and index production. 



(23.29) "Briefly, this index covers about 1,000 documents, each document being 



indexed under about 15 terms ... No master vocabulary was used, but an 
attempt wac made to be consistent in assigning index terms. Terms were 
alphabetized, arranged, and printed by machine ... Abstracts are bound in 
separata volumes. The costs of abstracting and assigning coordinate terms 
($12,680), machine indexing ($5,350), and reproduction ($2,300) worked out 
to $20.50 per document, which was believed to be exceptionally low." (ref. 
p. 192). " ... our indexing rate averaged 2-7/8 documents per hour." 

(ref . p. 195) . 
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Organization 



Science Information 
Exchange 



^ Thompson Ramo 
Wooldridge Inc. 
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Laboratories 



0 
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(13.43) 

(13.32) 

(11.19) 

(12.13- 

25.96) 



(1.15) 



Comments 



SIE indexes project descriptions for input to a computer file For a 3- 
month period, an average unit cost of $11,33 was reported to input a pro- 
ject into their file. This includes such things as registration, admin- 
istrative coding, reproduction, indexing, science analysis and coding, 
keypunching, computer processing, overhead. An additional average unit 
cost of $12.91 was also reported for this same time period for index 
maintenance. 

This same report cites the following input unit costs: 

FY1965, 1st half $12.18 

FY1965, 2nd half 12.08 

FY1966 , 1st quarter 10.45 

As with the above data, this did not include the index maintenance cost. 

A more general article on SIE, reporting 1967 experiences states that, '^To 
register, analyze, index, and store project records costs about $10 each." 

Estimate of costs of automatic indexing computer program, exclusive of 
costs of preparing the machine file of text, and costs of subsequent 
editing work. M . . . we arrive at a cost of something like one dollar per 
article for automatic indexing." 

A total of 37.58 man-min, per document were required to index and prepare 
an article for entry into a computer file for an SDI system. Of this time, 
17.4 man-min, were required to perform subject indexing. (ref. p. 59). 

"One trained subject indexer can index approximately 30 documents per day 
if the subject terms are dictated into a recording machine. If the indexer 
is required to write out the terms on an indexing worksheet, the task can 
be accomplished at the rate of 20 documents per day." (ref. p. 57). 
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Comments 



Re f 



;e 

:o 

ich 

ir 

1 $) 

;1968 

SValue 



/ ( 7 . 65 ) 



(7.55) 



[ (7 . 48- 
8.63) 



"After the normal period of training and practice, a metallurgical article 35 
may be analyzed in the above four ways (1. traditional annotations and 
abstracts for publication in Rev . Metal Li t . ; 2. telegraphic abstracts; 

3. standard subject index entries for use in the indexes of the bound an- 
nual volumes of Rev. Metal Lit .; 4. codes based on the ASM- SLA classifica- 
tion) at an average rate of one article per hour. The telegraphic ab- 
stract is produced in this way at an incremental cost of approximately 
$1.25 (above the cost of analysis required for Rev. Metal Lit .)" 

Total project input costs for a 13-month period were $239,345. The total 55 
per unit cost experienced to prepare both a conventional and telegraphic 
abstract was $6.50. This includes acquisitions, abstracting, editing and 
quality control, liaison activities, code making, automatic encoding, 
machine processing, supervision, equipment, supplies, subscriptions, 4 % 
fringe benefits, and 15% overhead. The costs are reported in detail for 
all of the subprocesses . jj 

Summary unit input cost is £>6.492 for more than a year of additional ex- 54 

perietice since the last cost report. This cost includes acquisitions, 
analysis, editing and quality control, liaison, code making, automatic 
encoding, supervision, computer processing, supplies, subscriptions, 5% 
fringe benefits, 20% overhead rate. The costs are reported in detail for 
all the subprocesses. * ■ 

Estimates of costs of projected system with input volume of 5-20 thousand 57 
documents, including all personnel (except the systems manager), equip- 
ment, employee benefits, and overhead. This estimate was based on prior 
WRIT operation of a pilot system with 4,000 documents. 



(3.98) f, Writing and indexing abstracts required one man-year. On a salary basis 19 
this is $7,000, however benefits and other overhead charges can be esti- 
mated at another $1,000 ... Machine costs are $720 per year. Card costs 
... are $57.60. Other paper supplies, filing cabinets, space rental 
amount to another $100." * ; 
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Comments 
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Interviews were made with indexers and their supervisors to obtain specif- 52 
ic information on the nature of their indexing process and the decision- 
making procedure. "The mean number of documents indexed daily for all of 
the indexers was found to be 27.0. The range was from 5 to 100 documents 
indexed daily." (ref. p. 4-67) 

"The following costs, which were obtained through thorough and reliable 22 

studies and comparisons, may be considered average for Germany: 



i Preparation of a bibliographic card with title 
and bibliographic sources of a publication 

Preparation of the same bibliographic card with 
added subject index 

Preparation of a bibliographic card containing 
an abstract or whatever facts are needed for 
mechanical selection 

Cost of classifying a title in decimal classi- 
fication or in another system 

4.3 DM = 1 dollar." 



1.00 DM ($0.23) 



3.00 DM ($0.70) 



10.00 DM ($2.33) 



1.00 DM ($0.23) 



•93) Jubscriptions, abstracting, editing, supervising, typing, clerical, and 
overhead costs are omitted. 



25 



: Table III 

ported for the Indexing Process 
(continued) 



O 

ERfC 



G> 



100 . 00 - 

9 * 

a 



o 250 




Note: Symbols with rays include abstracting. [ 



1950 


1952 


1954 


1956 


1958 


1960 


1962 


1964 


1966 


1968 










Year of Sample 


















Fig. 


III-l 












Costs of the Indexing Process 
(As Given, as a Function 
of the Year) 



q 327,50 



100 , 



10.00 




1 .00 



0.10 



ERIC 



Fig. III-2 

Costs of the Indexing Process 
(In Rank Order, Adjusted to 
1968 Dollar Values) 





Year of Sample 
Fig. III-3 

Indexing Rates 
(As a Function of the Year) 




ERiC 

iriilH 



Fig. III-4 

Indexing Rates 
(In Rank Order) 



REFERENCES 



1. Abdian, A. G. Defense Documentation Center. Private communication, 

February 4, 1970* 

2. American Mathematical Society. "Report of the Treasurer," May 31, 

1964. American Mathematical Society, Bulletin , v.71, no.l, 

March 1965, p.339-341. 

3. American Mathematical Society. ’'Report on the Affairs of the Society, 

American Mathematical Society, Notices , v.10, no. 6, Oct, 1963, 
p.548-549. 

4. Anzalone, Alfred M. , Carol A. Brokars, and Gunther Cohn* tf A Novel 

Index Tailored to Plastics Specialists." American Documentation , 
v.15, no. 3, July 1964, p.191-195. 

5. Association for Computing Machinery. "Financial Statements of the 

ACM." Communications of the ACM , v.ll, no. 2, Feb. 1968, p*136- 
137 . 

6. Association for Computing Machinery. "Financial Statements of the 

ACM." Communications of the ACM , v.12, no. 5, May 1969, p.295-296 

6a. Bachrach, C. A. National Library of Medicine. Private communication, 
March 5, 1970. 

7. Black, J. D. "The Keyword; Its Use in Abstracting, Indexing and Re- 

trieving Information." Aslib Proceedings , v.14, no. 10, Oct* 

1962, p, 313-321. 

8. Booz, Allen Applied Research Inc. Mechanization Study of the Plastics 

Technical Evaluation Center, U.S. Army, Picatinny Arsenal, Dover , 
N.J. . BARINC rpt . 914-1-12, Sept. 1966. AD 640 107. 35p. 

9. Bryant, E. C. Analysis of an Indexing and Retrieval Experiment for 

the Organometall i c File of the U.S. Patent Office . Prepared by 
Westat Research Analysts, Inc. Aug. 1963 for the U.S. Patent 
Office. Report WRA PO 10, Aug. 1963. 

10. Carlson, Walter M. "Structure and' Economics . " In Second National 

Symposium on Engineering Information . Engineers Joint Council, 

1965, p.43-47. 

11. Carss, Brian W. "The Development and Operation of an Education 

Resources Information Clearinghouse — (ERIC)." In Proceedings 
of the 1968 Clinic on Library Applications of Data Processing . 
University of Illinois, Graduate School of Library Science, 

1969. P.39-53. 

12. Carter, Launor F. and others. National Document Handling Systems 

for Science and Technology . Wiley, 1967. p. 307-308. 



13. 

14. 

15. 

16. 
16a 

17. 

18. 

19. 

20 . 
21 . 

22 . 

23. 

24. 

25. 

26. 







Chemical and Engineering News , v.42, no. 16, April 20, 1964, p.97. 

Chemical and Engineering News , v.42, no. 22, June 1964, p.81. 

Cleverdon, D. W. ?, The Evaluation of Systems Used in Information 
Retrieval." In Proceedings of the International Conference 
on Scientific Information , National Academy of Sciences, 1959. 

Vol . 1, p .687-698 . 

Conrad, G. Miles, f ^The Present Status of Biological Abstracts." 
Biological Abstracts , v.30, June 1956, p. 2129-2134. 

Coyne, J. G. Clearinghouse for Federal Scientific and Technical 
Information. Private Communication. March 3, 1970.. 

v 

Datatrol Corporation. Final Report on Phase 1, Systems Design and 
Action Plan, for the Pesticides Information Center, National 
Agricultural Library. Nov. 3, 1965. 

Dougherty, R. M. 1f The Scope and Operating Efficiency of Information 
Centers as Illustrated by the Chemical Biological Information 
Center of the National Research Council." College and Research 
Libraries , v. 25, no.l, Jan. 1964, p.7-12. 

Elias, A. W. "SCAN — A Flexible Scientific Literature System.” 

In ADI Proceedings, v.l, Parameters of Information Science , 

1964, p . 121-129 . 

"Engineering Index, Inc. Operating Statements 1961-1965.” Prepared 
by Tripartite Committee, June 1966. 

Federal Council for Science and Technology. Proceedings of the 
Second Symposium on Technical Information and the Federal 
Laboratory . April 13-14, 1964. p.41-45. 

Frank, Otto. "Cooperation and Coordination in Abstracting and 

Documentation.” In Proceedings of the International Conference 
on Scientific Information , National Academy of Science, 1959. 

Vol*. 1 , p.497-510 . 

Freeman, Monroe E. determining Costs of Information Systems.” 

Journal of Chemical Documentation , v.7, no. 2, May 1967, p. 101-106. 

Freeman, Monroe E. T1 The Science Information Exchange as a Source of 

Information." Special Libraries , v.59, no. 2, Feb. 1968, p.86-90. 

Friedenstein, Hanna. "Alerting with Internal Abstract Bulletins.” 

Journal of Chemical Documentation , v.5, no. 3, Aug. 1965, p.154—157 

Generaux, Raymond P. "The A.I.Ch.E. System for Information Retrieval." 
In Proceedings of the Engineering Information Symposium . 

Engineers Joint Council, New York City, Jan. 17, 1962. p.38-41. 



2 



27. Gerard, Gary. Kaiser Aluminum and Chemical. Private communication , 

Jan. 20, 1970. 

28. Gerrard, S. A. and D. F. Lyle. handling Industrial (Scientific and 

Technical) Confidential Report Material." Aslib Proceedings , 
v.18, no. 8, Aug. 1966, p.206-217. 

29. Hanson, C. W. "Costing Information Services." Aslib Proceedings , 

■ v.3, no.‘2, May 1951, p.85-90. 

30. Herner, Saul, F. W. Lancaster, Walter F. Johanningsmeier . "A Case 

Study in the Application of Cranfield System Evaluation Tech- 
niques. 11 Journal of Chemical Documentation , v.5, no.l, Jan. 

1965, p.92-95. 

31. Hyslop, Marjorie R. "Abstracting Cost Studies." Sci-Tech News , 

v.13, no.l. Spring 1959, p.5-6. 

32 e Hyslop, Marjorie R. American Society for Metals. Private communi- 
cation, Jan. 21, 1970. 

33. Keenan, Stella. "Abstracting and Indexing Services in Science and 

Technology . " In Annual Review of Information Science and 
Technology , v.4, 1969. Encyclopaedia Britannica, 1969, p.273- 
303. . 

34. Keenan, Stella. "Abstracting and Indexing Services in the Physical 

Sciences." Library Trends , v.16, no. 3, Jan. 1968, p.329-336. 

35. Kent, Allen. Exploitation of Recorded Information .1 . Development 

of an Operational Machine Searching Service for the Literature 
of Metallurgy and Allied Subjects." American Documentation , 
v.ll, no. 2, April 1960, p.173-188. 

36. King, Donald W. '^Designs of Experiments in Information Retrieval." 

Proceedings of the Social Statistics Section of the American 
Statistical Association , 1963, p. 103-118. 

37. King, Donald W. "Evaluation of Coordinate Index Systems During 

File Development." Journal of Chemical Documentation , v.5, 
no.l, Jan. 1965, p. 96-99. 

38. Lancaster, F. W. "MEDLARS: Report on the Evaluation of Its Oper- 

ating Efficiency . " American Documentation , v.20, no. 2, 

April 1969, p.119-142. 

39. Lancaster, F. W. "Some Observations on the Performance of EJC Role 

Indicators in a Mechanized Retrieval System." Special Libraries , 
v.55, no. 10, Dec. 1964, p.696-701. 



O 




3 



40. Landau, Herbert B. "The Cost Analysis of Document Surrogation: A 

Literature Review." American Documentation , v.20, no. 4, Oct. 

1969, p . 302-310 * 

41. Linder, L. H. "indexing Costs for 10,000 Documents." In Automation 

and Scientific Communication, Short Papers , Part 2 . American 
Documentation Institute, 1963, p.147-148 * 

42. Lipetz, Ben-Ami . Documentation Abstracts. Private communication, 

Jan. 1970. 

43. Logue, Paul. ‘‘Deep Indexing Technical Reports." Journal of Chemical 

Documentation , v.2, no. 4, 1962, p.215-219. 

44. Marin, Carmen M. Tobacco Abstracts. Private communication, Jan. 21, 

1970. 

45. Maurice, Jewell, Helen E. Loftus and Irene M. Strieby. "Company-Wide 

Library Service." Special Libraries , v.45, no. 2, Feb. 1954, 
p.53-57. 

46. Mohlman, J. W. "Costs of an Abstracting Program." Journal of 

Chemical Documentatio n, v.l, no. 2, July 1961, p.64-67. 

47. Montague, Barbara A. "Testing, Comparison, and Evaluation of Recall, 

Relevance, and Cost of Coordinate Indexing with Links and Roles." 
American Documentation , v.I6, no. 3, July 1965, p.201-208. 

48. National Agricultural Library. Agricultural Biological Literature 

Exploitation; Report of Task Force ABLE; a Systems Study of the 
National Agricultural Library and Its Users . March 1965, and 
revisions June 1965. p.414. 

49. National Federation of Science Abstracting and Indexing Services. 

Member Service Descriptions . The Federation, Technical report 
no.l, Oct. 1969. 

50. "National Library of Medicine Index Mechanization Project." Bulletin 

of the Medical Library Association , v.49, no.l, pt.2, Jan. 1961, 
p.72-79 . 

51. News from Science Abstracting and Indexing Services , v.ll, no. 3, 

June 1969, p.3. 

52. Oliver, Lawrence H. , and others. An Investigation of the Basic 

Processes Involved in the Manual Indexing of Scientific 
Documents . General Electric Company, Feb. 11, 1966. 




4 



53. Orr, Richard H. , Vern M. Pings, and Alice A. Leeds. ’Reference 

Retrieval Tools: Biomedical Abstracting and Indexing Ser- 

vices." Federation Proceedings , v.23, pt . 1 , 1964, p.1164- 
1176. ” 

54. Overmyer, LaVahn. "The Dollars and Cents of Basic Operations in 

Information Retrieval." In Information Retrieval in Action , 
Western Reserve University, 1963. p.199-211. 

55. Overmyer, LaVahn. "Test Program for Evaluating Procedures for the 

Exploitation of Literature of Interest to Metallurgists." 
American Documentation , v.13, no. 2, April 1962. p, 210-222. 

56. Parkins, Phyllis V. fl BioSciences Information Service of Biological 

Abstracts." Science , v.152, no. 3724, May 13, 1966, p.889-894. 



57. Reeves, Pamela, and others. The Library of Tomorrow — Today . 

Center for Documentation and Communication Research, Western 
Reserve University, 1962. Chapt. 6. 

58. Rigby, Malcolm and Marian K. Rigby. "Cost Analysis of Bibliographies 

or Bibliographic Services." In Proceedings of the International 
Conference on Scientific Information . National Academy of 
Sciences, 1959. Vol.l^ p.381-392. 

59. Rowlett, Russell J. Chemical Abstracts Service. Private communica- 

tion, Feb, 17, 1970. 

60. Russell, Martin and Robert R. Freeman. Computer-Aided Indexing of a 

Scientific Abstracts Journal by the UPC with UNIDEK; a Case 
Study . American Institute of Physics, rpt . AIP/UDC-4, April 1, 
1967. 26p. 

61. Schmidt, C. J., R. P. Wesley, and C. H. Hunter. "kAPL's Automated 

Information Retrieval System. " In ADI Proceedings, v.l , 
Parameters of Information Science , 1964, p.177-184. 

62. Schutze, Gertrude. Documentation Sourcebook . Scarecrow, 1965. 

63. "Science Information Services in the United States." Biological 

Abstracts , v.36, no. 14, July 15, 1961, p.xii, 

64. Sewell, Winifred. "Problems of Issuing a Company Pharmaceutical 

Abstract Bulletin." Special Libraries , v.45, no. 2, Feb. 1954, 
p.63-66 . 

65. Snyder, Richard L. Documentation Abstracts. Private communication, 

Jan. 1970. 




5 



66. Speight, Frank Y. and Norman E. Cottrell. The EJC Engineering 

Information Program — 1966-67 . Engineers Joint Council, 

Feb. 1967. 45p. 

67. Stevens, M. E. Automatic Indexing: A State-of-the-Art Report . 

U.S. National Bureau of Standards, Monograph 91, 1965. 220p. 

68. Stevens, Norman D. A Comparative Study of Three Systems of Infor- 

mation Retrieval . Rutgers University Press, 1960. 

69. Swanson, Bon R. "Library Goals and the Role of Automation." 

Special Libraries , v.53, no. 9, Oct. 1962, p. 466-471. 

70. System Development Corporation. Recommendations for National 

Document Handling Systems in Science and Technology . 

Appendix A - Background Study. Vol. II. 1965. PB 168 267. 

AD 624 560. " “ 

71. System Development Corporation. A Study of Abstracting 

and Indexing in the United States . Dec . 16 , 1966 . PB 174 249 . 

72. Taylor, L. "Cost Research on a Library Service." Aslib Proceedings , 

v . 13 , Sept. 1961, p . 238-248 . 

73. U.S. Army Laboratories. Selective Dissemination of Information , 

Volume 1; Pilot Test at U.S. Army NAtick Laboratories . 

ATLIS rpt . 15 , May 1956. AD 654 997. 

74. U.S. Navy. Bureau of Ships. Project SHARP Information Storage and 

Retrieval System; Evaluation of Indexing Procedures and 
Retrieval Effectiveness . NAVSHIFS 250-210-3, June 1964, 49p. 

75. Van Gulick, Robert R, Biosciences Information Service. Private 

communication, Jan. 28, 1970. 

76. Vig, No man J. A Report on the Classification Operation in the 

U.S. Patent Office . Unpublished report, Office of Research 
and Development, Sept. 14, 1962^ Cited by Edward C. Bryant, 

A Progress Report on Search System Evaluation in the United 
States Patent Office . Westat Research Analysts, Inc. WRA 
P0 14, May 1964. 

77. Wetsel, F. R. f *Time Studies in Producing Subject Indexes for 

Chemical Abstracts ." Journal of Chemical Documentation , v.5, 
no. 4, Nov. 1965, p. 212-214. 

78. Whaley, Fred R. "Operational Experience with Linde’s Indexing and 

Retrieval System." In Information Retrieval Systems Conference , 
IBM, Sept. 21-23, 1959. IBM, E2G-8040. 

79. Woods, Bill M. Engineering Index, Inc. Private communication, 

Feb. 17 and April 9, 1970. 




6 



